Facial animation parameters extraction and expression recognition using Hidden Markov Models
نویسندگان
چکیده
∗ This work has been supported by the European project InterFace and TIC2001-0996 of the Spanish Government The video analysis system described in this paper aims at facial expression recognition consistent with the MPEG4 standardized parameters for facial animation, FAP. For this reason, two levels of analysis are necessary: low level analysis to extract the MPEG4 compliant parameters and high level analysis to estimate the expression of the sequence using these low level parameters.
منابع مشابه
Research on Emotion Recognition for Facial Expression Images Based on Hidden Markov Model
This paper introduces emotion recognition for facial expression images using Hidden Markov Model (HMM). Firstly, facial expression images are transformed using discrete cosine transformation and feature is extraction; then HMMs of facial expression images are constructed, and the observation vectors are generated using sub-window, hence, process of emotion recognition for facial expression imag...
متن کاملMulti-Modal Emotion Recognition Fusing Video and Audio
Emotion plays an important role in human communications. We construct a framework for multi-modal fusion emotion recognition. Facial expression features and speech features are respectively extracted from image sequences and speech signals. In order to locate and track facial feature points, we construct an Active Appearance Model for facial images with all kinds of expressions. Facial Animatio...
متن کاملHMM recognition of expressions in unrestrained video intervals
This paper discusses the application of a facial expression recognition system in unrestrained video intervals. The system is based on the modeling of the expressions by means of Hidden Markov Models. The observations used to create the models are the MPEG-4 standardized Facial Animation Parameters (FAPs). The FAPs of a video sequence are first extracted and then analyzed using semi-continuous ...
متن کاملA coupled HMM approach to video-realistic speech animation
We propose a coupled hidden Markov model (CHMM) approach to video-realistic speech animation, which realizes realistic facial animations driven by speaker independent continuous speech. Different from hidden Markov model (HMM)-based animation approaches that use a singlestate chain, we use CHMMs to explicitly model the subtle characteristics of audio–visual speech, e.g., the asynchrony, tempora...
متن کاملSpeech and Expression Driven Animation of a Video-Realistic Appearance Based Hierarchical Facial Model
We describe a new facial animation system based on a hierarchy of morphable sub-facial appearance models. The innovation in our approach is that through the hierarchical model, parametric control is available for the animation of multiple sub-facial areas. We animate these areas automatically both from speech to produce lip-synching, and natural pauses and hesitations and using specific tempora...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Sig. Proc.: Image Comm.
دوره 17 شماره
صفحات -
تاریخ انتشار 2002